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Amendments to the Claims: 

This listing of claims will replace all prior versions and listings of claims in the 
application. Applicants submit here-below a new complete claim set showing marked up 
claims with insertions indicated by underlining and deletions indicated by strikeouts 
and/or double bracketing. 

Listing of Claims: 

1 . (Currently Amended) A method comprising: 

generating derivatives of a nonlinear invariance transformation at a training data 
point with respect to a transformation parameter, the training data point representing 
one of a plurality of training patterns; and 

generating a classifier representation based on the derivatives for classifying a 
test pattern in the presence of the nonlinear invariance transformation; 

wherein the nonlinear invariance transformation models a change in lighting 
angle in an individual training pattern . 

2. (Original) The method of claim 1 further comprising: 
classifying the test pattern based on the classifier representation. 

3. (Original) The method of claim 1 further comprising: 

receiving the plurality of training patterns; and 

characterizing one of the training patterns to provide the training data point. 
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4. (Original) The method of claim 1 further comprising: 

classifying the test pattern based on the classifier representation to provide a 
classification signal; and 

inputting the test pattern to the operation of generating derivatives as a training 
pattern, responsive to the classifying operation. 

5. (Original) The method of claim 1 further comprising: 

classifying the test pattern based on the classifier representation to provide a 

classification signal; 

inputting the test pattern to the operation of generating derivatives as a training 
pattern; and 

inputting the classification signal to the operation of generating derivatives in 
association with the test pattern. 

6. (Original) The method of claim 1 wherein the non-linear invariant transformation 
is represented by a Taylor expansion polynomial. 

7. (Canceled) 

8. (Canceled) 

9. (Canceled) 

10. (Currently Amended) The method of claim 1 embodied as computer-readable 

instruction on computer-readable media, w here i n the non li near i nvar i anco 

transformat i on mode l s a change i n li ght i ng ang l e i n an i nd i v i dual tra i n i ng pattern . 
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1 1 . (Canceled) 

12. (Canceled) 

13. (Canceled) 

14. (Canceled) 

15. (Canceled) 

16. (Original) The method of claim 1 wherein the test pattern includes an image. 

1 7. (Original) The method of claim 1 wherein the test pattern includes an audio 
input. 

1 8. (Original) The method of claim 1 wherein the test pattern includes a handwriting 
pattern. 

1 9. (Original) The method of claim 1 wherein the test pattern includes a time series. 

20. (Original) The method of claim 1 further comprising: 

restricting a range of the transformation parameter to a closed interval on a line 

of real numbers. 
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21. (Original) The method of claim 1 further comprising: 

representing a scalar product of the classifier representation with the derivatives 
of the nonlinear invariance transformation at the training data point with respect to the 
transformation parameter by a nonlinear positive definite real-valued kernel function. 

22. (Original) The method of claim 1 wherein the operation of generating derivatives 
comprises: 

generating derivatives of the nonlinear invariance transformation at the training 
data point with respect to a plurality of transformation parameters. 

23. (Currently Amended) A method computer program product encod i ng a computer 
program for execut i ng on a computer system a computer process, the computer process 
comprising: 

generating derivatives of a nonlinear invariance transformation at a training data 
point with respect to a transformation parameter, the training data point representing 
one of a plurality of training patterns; and 

generating a classifier representation based on the derivatives for classifying a 
test pattern in the presence of the nonlinear invariance transformation; 

wherein the nonlinear invariance transformation models a change in brightness 
in an individual training pattern . 

24. (Currently Amended) The method computer program product of claim 23 

wherein the computer process further comprises: 

classifying the test pattern based on the classifier representation. 

Microsoft Corporation 
Type of Response: Amendment 
Application Number: 10/697,727 
Attorney Docket Number: 30601 7.01 

5 of 26 



PATENT 



25. (Currently Amended) The method computer program product of claim 23 
wherein the computer process further comprises: 

receiving the plurality of training patterns; and 

characterizing one of the training patterns to provide the training data point. 

26. (Currently Amended) The method computer program product of claim 23 
wherein the computer process further comprises: 

classifying the test pattern based on the classifier representation; and 
inputting the test pattern to the operation of generating derivatives as a training 
pattern, responsive to the classifying operation. 

27. (Currently Amended) The method computer program product of claim 23 
wherein the computer process further comprises: 

classifying the test pattern based on the classifier representation to provide a 
classification signal; 

inputting the test pattern to the operation of generating derivatives as a training 
pattern; and 

inputting the classification signal to the operation of generating derivatives in 
association with the test pattern. 

28. (Currently Amended) The method computer program product of claim 23 
wherein the non-linear invariant transformation is represented by a Taylor expansion 
polynomial. 

29. (Canceled) 
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30. (Canceled) 

31. (Canceled) 

32. (Canceled) 

33. (Currently Amended) The method computer program product of claim 23 
embodied as computer-executable instructions on computer-readable media, whefelw 
the non li nGar i nvar i ancc transformat i on mode l s a change i n br i ghtness i n an i nd i v i dua l 
training pattern. 

34. (Canceled) 

35. (Canceled) 

36. (Canceled) 

37. (Canceled) 

38. (Currently Amended) The method computer program product of claim 23 
wherein the test pattern includes an image. 

39. (Currently Amended) The method computer program product of claim 23 
wherein the test pattern includes an audio input. 
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40. (Currently Amended) The method computer program product of claim 23 
wherein the test pattern includes a handwriting pattern. 

41 . (Currently Amended) The method computer program product of claim 23 
wherein the test pattern includes a time series. 

42. (Currently Amended) The method computer program product of claim 23 
wherein the computer process further comprises: 

restricting a range of the transformation parameter to a closed interval on a line 
of real numbers. 

43. (Currently Amended) The method computer program product of claim 23 
wherein the computer process further comprises: 

representing a scalar product of the classifier representation with the derivatives 
of the nonlinear invariance transformation at the training data point with respect to the 
transformation parameter by a nonlinear positive definite real-valued kernel function. 

44. (Currently Amended) The method computer program product of claim 23 
wherein the operation of generating derivatives comprises: 

generating derivatives of the nonlinear invariance transformation at the training 
data point with respect to a plurality of transformation parameters. 
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45. (Currently Amended) A system comprising: 

a derivative generator generating derivatives of a nonlinear invariance 
transformation at a training data point with respect to a transformation parameter, the 
training data point representing one of a plurality of training patterns; and 

a classifier representation generator generating a classifier representation based 
on the derivatives for classifying a test pattern in the presence of the nonlinear 
invariance transformation; 

wherein the nonlinear invariance transformation models a change in lighting 
angle in an individual training pattern. 

46. (Original) The system of claim 45 further comprising: 

a classifier classifying the test pattern based on the classifier representation, 
a training data characterizer receiving the plurality of training patterns and 
characterizing one of the training patterns to provide the training data point. 

47. (Original) The system of claim 45 wherein the derivative generator inputs the test 
pattern as a training pattern. 

48. (Original) The system of claim 45 further comprising: 

a classifier classifying the test pattern based on the classifier representation to 
provide a classification signal, wherein the derivative generator inputs the test pattern 
as a training pattern and inputs the classification signal in association with the test 
pattern. 

49. (Original) The system of claim 45 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial. 
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50. (Original) The system of claim 45 wherein the test pattern includes an image. 

51 . (Original) The system of claim 45 wherein the test pattern includes an audio 
input. 

52. (Original) The system of claim 45 wherein the test pattern includes a handwriting 
pattern. 

53. (Original) The system of claim 45 wherein the test pattern includes a time series. 

54. (Original) The system of claim 45 wherein a range of the transformation 
parameter is restricted to a closed interval on a line of real numbers. 

55. (Original) The system of claim 45 wherein a nonlinear positive definite real- 
valued kernel function represents a scalar product of the classifier representation with 
the derivatives of the nonlinear invariance transformation at the training data point with 
respect to the transformation parameter. 

56. (Original) The system of claim 45 wherein the classifier representation generator 
generates derivatives of the nonlinear invariance transformation at the training data 
point with respect to a plurality of transformation parameters. 
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57. (Currently Amended) A method comprising: 

characterizing a plurality of training patterns, each training pattern 
corresponding to a training data point in a feature space; 

determining a classification for each training pattern; 

generating derivatives of a nonlinear invariance transformation at individual 
training data points with respect to a transformation parameter; and 

generating an optimized weight vector, based on the derivatives and the 
classification of each training pattern, for classifying a test pattern in the presence of 
the nonlinear invariance transformation, 

wherein the nonlinear invariance transformation models a change in lighting 
angle in an individual training pattern . 

58. (Original) The method of claim 57 further comprising: 
classifying the test pattern based on the optimized weight vector. 

59. (Original) The method of claim 57 further comprising: 

classifying the test pattern based on the optimized weight vector to provide a 
classification signal; and 

inputting the test pattern to the operation of generating derivatives as a training 
pattern, responsive to the classifying operation. 
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60. (Original) The method of claim 57 further comprising: 

classifying the test pattern based on the optimized weight vector to provide a 
classification signal; 

inputting the test pattern to the operation of generating derivatives as a training 
pattern; and 

inputting the classification signal to the operation of generating derivatives in 
association with the test pattern. 

61 . (Original) The method of claim 57 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial. 

62. (Currently Amended) A method computer program product encod i ng a computer 
program for execut i ng on a computer system a computer process, the computer process 
comprising: 

characterizing a plurality of training patterns, each training pattern 
corresponding to a training data point in a feature space; 

determining a classification for each training pattern; 

generating derivatives of a nonlinear invariance transformation at individual 
training data points with respect to a transformation parameter; and 

generating an optimized weight vector, based on the derivatives and the 
classification of each training pattern, for classifying a test pattern in the presence of 
the nonlinear invariance transformation; 

wherein the nonlinear invariance transformation models a change in brightness 
in an individual training pattern . 
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63. (Currently Amended) The method computer program product of claim 62 
wherein the computer process further comprises: 

classifying the test pattern based on the optimized weight vector. 

64. (Currently Amended) The method computer program product of claim 62 
wherein the computer process further comprises: 

characterizing one of the training patterns to provide the training data point. 

65. (Currently Amended) The method computer program product of claim 62 
wherein the computer process further comprises: 

classifying the test pattern based on the optimized weight vector; and 
inputting the test pattern to the operation of generating derivatives as a training 
pattern, responsive to the classifying operation. 

66. (Currently Amended) The method computer program product of claim 62 
wherein the computer process further comprises: 

classifying the test pattern based on the optimized weight vector to provide a 
classification signal; 

inputting the test pattern to the operation of generating derivatives as a training 
pattern; and 

inputting the classification signal to the operation of generating derivatives in 
association with the test pattern. 

67. (Currently Amended) The method computer program product of claim 62 
wherein the non-linear invariant transformation is represented by a Taylor expansion 
polynomial. 
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68. (Currently Amended) A system comprising: 

a training data characterizer characterizing a plurality of training patterns, each 
training pattern corresponding to a training data point in a feature space and 
determining a classification for each training pattern; 

a derivative generator generating derivatives of a nonlinear invariance 
transformation at individual training data points with respect to a transformation 
parameter; and 

a classifier representation generator generating an optimized weight vector, 
based on the derivatives and the classification of each training pattern, for classifying a 
test pattern in the presence of the nonlinear invariance transformation; 

wherein the nonlinear invariance transformation models a change in lighting 
angle in an individual training pattern . 

69. (Original) The system of claim 68 further comprising: 

a classifier classifying the test pattern based on the classifier representation. 

70. (Original) The system of claim 68 further comprising: 

a training data characterizer receiving the plurality of training patterns and 
characterizing one of the training patterns to provide the training data point. 

71 . (Original) The system of claim 68 wherein the derivative generator inputs the test 
pattern as a training pattern. 
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72. (Original) The system of claim 68 further comprising: 

a classifier classifying the test pattern based on the classifier representation to 
provide a classification signal, wherein the derivative generator inputs the test pattern 
as a training pattern and inputs the classification signal in association with the test 
pattern. 

73. (Original) The system of claim 68 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial. 

74. (New) A system comprising: 

a derivative generator generating derivatives of a nonlinear invariance 
transformation at a training data point with respect to a transformation parameter, the 
training data point representing one of a plurality of training patterns; and 

a classifier representation generator generating a classifier representation based 
on the derivatives for classifying a test pattern in the presence of the nonlinear 
invariance transformation; 

wherein the nonlinear invariance transformation models a change in brightness 
in an individual training pattern. 

75. (New) The system of claim 74 further comprising: 

a classifier classifying the test pattern based on the classifier representation, 
a training data characterizer receiving the plurality of training patterns and 
characterizing one of the training patterns to provide the training data point. 

76. (New) The system of claim 74 wherein the derivative generator inputs the test 
pattern as a training pattern. 
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77. (New) The system of claim 74 further comprising: 

a classifier classifying the test pattern based on the classifier representation to 
provide a classification signal, wherein the derivative generator inputs the test pattern 
as a training pattern and inputs the classification signal in association with the test 
pattern. 

78. (New) The system of claim 74 wherein the non-linear invariant transformation is 
represented by a Taylor expansion polynomial. 

79. (New) The system of claim 74 wherein the test pattern includes an image. 

80. (New) The system of claim 74 wherein the test pattern includes an audio input. 

81 . (New) The system of claim 74 wherein the test pattern includes a handwriting 
pattern. 

82. (New) The system of claim 74 wherein the test pattern includes a time series. 

83. (New) The system of claim 74 wherein a range of the transformation parameter is 
restricted to a closed interval on a line of real numbers. 

84. (New) The system of claim 74 wherein a nonlinear positive definite real-valued 
kernel function represents a scalar product of the classifier representation with the 
derivatives of the nonlinear invariance transformation at the training data point with 
respect to the transformation parameter. 

Microsoft Corporation 
Type of Response: Amendment 
Application Number: 10/697,727 
Attorney Docket Number: 30601 7.01 



16 of 26 



PATENT 



85. (New) The system of claim 74 wherein the classifier representation generator 
generates derivatives of the nonlinear invariance transformation at the training data 
point with respect to a plurality of transformation parameters. 

86. (New) The method of claim 57 embodied as computer-executable instructions 
on computer-readable media. 

87. (New) The method of claim 62 embodied as computer-executable instructions 
on computer-readable media. 

88. (New) A system comprising: 

a training data characterizer characterizing a plurality of training patterns, each 
training pattern corresponding to a training data point in a feature space and 
determining a classification for each training pattern; 

a derivative generator generating derivatives of a nonlinear invariance 
transformation at individual training data points with respect to a transformation 
parameter; and 

a classifier representation generator generating an optimized weight vector, 
based on the derivatives and the classification of each training pattern, for classifying a 
test pattern in the presence of the nonlinear invariance transformation; 

wherein the nonlinear invariance transformation models a change in brightness 
in an individual training pattern. 

89. (New) The system of claim 88 further comprising: 

a classifier classifying the test pattern based on the classifier representation. 
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90. (New) The system of claim 88 further comprising: 

a training data characterizer receiving the plurality of training patterns and 
characterizing one of the training patterns to provide the training data point. 

91 . (New) The system of claim 88 wherein the derivative generator inputs the test 
pattern as a training pattern. 

92. (New) The system of claim 88 further comprising: 

a classifier classifying the test pattern based on the classifier representation to 
provide a classification signal, wherein the derivative generator inputs the test pattern 
as a training pattern and inputs the classification signal in association with the test 
pattern. 

93. (New) The system of claim 88 wherein the non-linear invariant transformation is 
represented by a Taylor expansion polynomial. 
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